
United States Patent and Trademark Office 1 




UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 
Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria, Virginia 223 1 3- 1 450 
www.uspto.gov 



APPLICATION NO. 



FILING DATE 



FIRST NAMED INVENTOR 



ATTORNEY DOCKET NO. 



CONFIRMATION NO. 



09/882,416 



06/15/2001 



7590 



08/23/2006 



Petrus Van Beek 



Timothy A. Long 

Cheraoff, Vilhauer, McClung and Stenzel, L.L.P. 
1600 ODS Tower 
601 SW Second Ave. 
Portland, OR 97204 



KLR 7146.100 



8410 



EXAMINER 



PHAM, KHANH B 



ART UNIT 



PAPER NUMBER 



2166 

DATE MAILED: 08/23/2006 



Please find below and/or attached an Office communication concerning this application or proceeding. 



PTO-90C (Rev. 10/03) 



Office Action Summsrv 


Application No. 

09/882,416 


Applicant(s) 
BEEK ET AL. 


Examiner 
Khanh B. Pham 


Art Unit 
2166 





- The MAILING DATE of this communication appears on the cover sheet with the correspondence address -- 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )E3 Responsive to communication(s) filed on 25 April 2006 . 
2a)D This action is FINAL. 2b)^ This action is non-final. 

3) Q Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-59 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) g] Claim(s) 1-59 is/are rejected. 

7) \3 Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

£))□ The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1 .121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .D Certified copies of the priority documents have been received. 

2. Q Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1) □ Notice of References Cited (PTO-892) 

2) O Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) D Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 

Paper No(s)/Mail Date . 



4) □ Interview Summary (PTO-413) 

Paper No(s)/Mail Date. . 

5) Q Notice of Informal Patent Application (PTO-152) 

6) □ Other: . 



U.S. Patent and Trademark Office 
PTOL-326 (Rev. 7-05) 



Office Action Summary 



Part of Paper No./Mail Date 20060818 



Application/Control Number: 09/882,416 Page 2 

Art Unit: 2166 

DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1. A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.1 14, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on April 25 
2006 has been entered. 

Response to 1.132 Declaration 

2. The Declaration under 37 CFR 1 .132 filed April 25 2006 is insufficient to 
overcome the rejection of claims based upon and Qian references as set forth in the last 
Office action because: 

Applicant attempted to disqualify Qian as a prior art reference by submitting a 
statement which states that: "the subject matter disclosed in, and claimed by, the 
present application was reduced to practice on a date prior to May 30, 2000 the 
effective date of Qian et al., U.S. Patent No. 6,070,167 and provided evidence to 
support the fact that the disclosed subject matter was reduce to practice before May 
30, 2000. The Declaration is therefore treated by the examiner as a Declaration under 
37 CFR 1.131. 
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However, the Declaration is ineffective because the effective filing date of the 
Qian reference is September 29, 1997. MPEP provides: "the date to be overcome 
under 37 CFR 1 .131 is the effective U.S. filing date, not the foreign priority date. When 
a U.S. patent or U.S. patent application publication reference is entitled to claim the 
benefit of an earlier filed application, its effective filing date is determined under 35 
U.S.C. 102(e). See MPEP § 706.02(a), § 706.02(f)(1), and § 2136 through § 
2136.03". 

Qian therefore remains as proper 102(e) type reference. 

Claim Rejections - 35 USC § 101 

3. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

Claims 1-59 are rejected under 35 U.S.C. 101 because the claimed invention is 
directed to non-statutory subject matter. 

Claims 1-59 direct to "a digital file stored on a computer readable medium"; 
however, the claimed "digital file" contains only non-functional descriptive material. 

Descriptive material can be characterized as either "functional descriptive 
material" or "nonfunctional descriptive material". In this context, "functional descriptive 
material" consists of data structures and computer programs which impart functionality 
when employed as a computer component. (The definition of "data structure" is "a 
physical or logical relationship among data elements, designed to support specific data 
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manipulation functions." The New IEEE Standard Dictionary of Electrical and Electronic 
Terms 308 (5 th ed. 1993).). 

"Nonfunctional descriptive material" includes, but is not limited to music, literary 
works, and compilation or mere arrangement of data. Both type of "descriptive 
material" are nonstatutory when claimed as descriptive material per se . Warmerdam . 33 
F. 3d at 1360, 31 USPQ2d at 1759. When functional descriptive material is recorded on 
some computer-readable medium it becomes structurally and functionally interrelated to 
the medium and will be statutory in most cases since use of technology permits the 
function of the descriptive material to be realized. Claims 1-59 are directed to 
nonfunctional descriptive material per se and therefore nonstatutory. 

Claim Rejections - 35 USC § 102 

4. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(a) the invention was known or used by others in this country, or patented or described in a printed 
publication in this or a foreign country, before the invention thereof by the applicant for a patent. 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

5. Claims 41-42, 46 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Pereira ("MPEG-7: a Standard for Describing Audiovisual Information", 1999), 
hereinafter "Pereira". 
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As per claim 41 , Pereira teaches a digital file stored on a computer readable 
medium (page 6/4, 3 rd paragraph), said digital file comprising: 

• "a MPEG-7 description scheme that includes the identification of the format of at 
least one of audio and visual media" at page 6/1 , last paragraph; 

• "said description scheme including data for rendering said at least one of said 
audio and visual media" at page 6/2, 2 nd paragraph (i.e., "reproduction 
data"); 

• "said at least one of said audio and visual media being contained within said 
description scheme" at page 6/2, 2 nd paragaph. (Pereira teaches that 
"MPEG-7 descriptions may be physically co- located with the 
'reproduction data', in the same data stream") 

As per claim 42, Pereira teaches the digital file of claim 41 wherein "said 
description scheme is InlineMedia". 

(The examiner relies on Applicant's specification for the 
definition of "InlineMedia", "that permits the identification of 
the format of the media stream" and "enables the description of 
audio and/or visual data located within the description itself, 
without having to refer to a location external to the 
description" (page 7, last paragraph). As discussed in the 
rejection of claim 41 above, Pereira teaches a similar 
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description scheme and therefore anticipated the claimed 
element . ) 

As per claim 46, Pereira teaches the digital file of claim 41 wherein "said data is 
binary" at page 6/1, 2 nd paragraph (i.e. , "digital" format) . 

6. Claims 47-49 and 54 are rejected under 35 U.S.C. 102(a) as being anticipated 
by "JPEG 2000 Image Coding System" Final Committee Draft Version 1.0, March 16, 
2000, (supplied by Applicant in IDS, paper No. 6), hereinafter "IT-JPEG2000". 

As per claim 47, IP-JPEG2000 teaches a digital file stored on a computer 
readable medium (see page 139, Fig. 1-1), said digital file comprising: 

• "a plurality of boxes containing data arranged in a manner consistent with the 
JPEG2000 specification and suitable to render an image" at page 139, Fig. 1-1; 

• "at least one of said boxes being at least one of a metadata box and a UUID box" 
at page 139, Fig. 1-1, page 140, section I.4.5 and page 158, section 1.9.2; 

• "including information within said at least one of said metadata box and said 
UUID box indicating the location of binary data, within said file and not within said 
at least one of said metadata box and said UUID box, associated with said 
image" at page 158, sections I.9.2 and I.9.3. 

(IT-JPEG2000 teaches that UUID boxes can be used to store 
binary data, and UUID Info boxes, which act as index for the 
UUID's in the file, contains a list of UUID's and specifies 
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links (i.e., "location") to more information. UUID boxes and 
UUID Info boxes are distinct but within the JPEG2000 file.) 

As per claim 48, IP-JPEG2000 teaches the digital file of claim 47 wherein "said 
information is in XML format" at page 157, section 1.9.1. 

As per claim 49, IP-JPEG2000 teaches the digital file of claim 47 wherein "said 
digital file is compliant with the JPEG2000 standard" at page 140, section I.4.6. 

As per claim 54, IT-JPEG2000 teaches the digital file of claim 47 wherein "said 
information includes links to information external to said digital file" at page 159, section 
I.9.3.2. 

Claim Rejections - 35 USC § 103 

7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

8. This application currently names joint inventors. In considering patentability of 
the claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of 
the various claims was commonly owned at the time any inventions covered therein 
were made absent any evidence to the contrary. Applicant is advised of the obligation 
under 37 CFR 1 .56 to point out the inventor and invention dates of each claim that was 
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not commonly owned at the time a later invention was made in order for the examiner to 
consider the applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) 
prior art under 35 U.S.C. 103(a). 

9. Claims 1-40, 50-53 and 55-59 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over IT-JPEG2000 as applied to claims 47-49 and 54 above, and in view 
of Qian et al. (US 6,070,167), hereinafter "Qian". 

As per claim 1 , IT-JPEG2000 teaches a digital file stored on a computer 
readable medium (page 139, Fig. 1-1) comprising: 

• "a plurality of boxes containing data arranged in a manner consistent with the 
JPEG2000 specification and suitable to render an image when read by a 
computer" at page 139, Fig. 1-1; 

• "at least one of said boxes being a metadata box" at page 140 section 1. 4. 5; 

IT-JPEG2000 teaches the ability to add data to metadata boxes of a JPEG2000 
file (section I.4.5) but does not explicitly teach: "including information within said 
metadata box describing the content of said image" as claimed. However, Qian teaches 
an analogous method that enable association of descriptive data to an JPEG2000 
image to provide interactivity with said image at Col. 1 lines 59-67 and Col. 2 line 30-50. 
Thus, it would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to combine IT-JPEG2000 and Qian's teachings. Qian suggests 
adding descriptive data information to a JPEG2000 file in order to "utiliz[e] such 
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information in content-based information retrieval, object-based editing and 
manipulation application" at Col. 2, lines 30-35 and Col. 4 lines 13-25. 

As per claim 2, IT-JPEG2000 and Qian teach the digital file of claim 1 as 
discussed above. IT-JPEG2000 also teaches: "wherein said information is in XML 
format" at page 157, section 1.9.1. 

As per claim 3, IT-JPEG2000 and Qian teach the digital file of claim 1 as 
discussed above. IT-JPEG2000 also teaches: "wherein said digital file is compliant with 
the JPEG2000 standard" at page 140, section I.4.6. 

As per claim 4, IT-JPEG2000 and Qian teach the digital file of claim 1 as 
discussed above. Qian also teaches: "wherein said information provides interactivity 
within said image" at Col. 4 lines 13-25. 

As per claim 5, IT-JPEG2000 and Qian teach the digital file of claim 4 as 
discussed above. Qian also teaches: "wherein said interactivity includes providing a 
bounding region of a portion of said image" at Col. 2, lines 45-50. 

As per claim 6, IT-JPEG2000 and Qian teach the digital file of claim 5 as 
discussed above. Qian also teaches: "wherein said bounding region is rectangular" at 
Col. 2 lines 39-40. 

As per claim 7, IT-JPEG2000 and Qian teach the digital file of claim 5 as 
discussed above. Qian also teaches: "wherein additional information regarding said 
content is associated with said bounding region of said image" at Col. 5 lines 22-30. 
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As per claim 8, IT-JPEG2000 and Qian teach the digital file of claim 1 as 
discussed above. Qian also teaches: "wherein said information includes links to 
information external to said digital file" at Col. 2 lines 48-51. 

As per claim 9 IT-JPEG2000 and Qian teach the digital file of claim 1 as 
discussed above. Qian also teaches: "wherein said information includes voice 
annotation" at Col. 5 line 24. 

As per claim 10, IT-JPEG2000 and Qian teach the digital file of claim 1 as 
discussed above. Qian also teaches: "wherein said information includes object 
boundary information" at Col. 5 line 24. 

As per claim 11 , IT-JPEG2000 and Qian teach the digital file of claim 1 as 
discussed above. Qian also teaches: "wherein said information includes textual 
information regarding the content of said image free from copyright information" at Col. 
5 lines 23-24 and Col. 6 lines 15-17. 

As per claim 12, IT-JPEG2000 and Qian teach the digital file of claim 1 as 
discussed above. Qian also teaches: "wherein said information is MPEG-7 data" at Col. 
5 lines 25-30. 

As per claim 13, IT-JPEG2000 and Qian teach the digital file of claim 12 as 
discussed above. Qian also teaches: "wherein said MPEG-7 data is compliant with the 
MPEG-7 specification" at Col. 5 lines 25-29. 
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As per claim 14, IT-JPEG2000 and Qian teach the digital file of claim 12 as 
discussed above. Qian also teaches: "wherein said information includes binary data" at 
Col. 6 lines 1-20. 

As per claim 15, IT-JPEG2000 teaches a digital file stored on a computer 
readable medium comprising: 

• "a plurality of boxes containing data arranged in a manner consistent with the 
JPEG2000 specification and suitable to render an image when read by a 
computer" at page 139, Fig. 1-1; 

• "at least one of said boxes being a UUID box" at page 158, section I.9.2. 

IT-JPEG2000 teaches the ability to add data to UUID boxes of a JPEG2000 file 
(section I.9.3) but does not explicitly teach: "including information within said UUID box 
describing the content of said image" as claimed. However, Qian teaches an analogous 
method that enable association of descriptive data to an JPEG2000 image to provide 
interactivity with said image at Col. 1 lines 59-67 and Col. 2 line 30-50. Thus, it would 
have been obvious to one of ordinary skill in the art at the time of the invention was 
made to combine IT-JPEG2000 and Qian's teachings because Qian suggests adding 
descriptive data information to a JPEG2000 file in order to "utiliz[e] such information in 
content-based information retrieval, object-based editing and manipulation application" 
at Col. 2, lines 30-35 and Col. 4 lines 13-25. 
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As per claim 16, IT-JPEG2000 and Qian teach the digital file of claim 15 as 
discussed above. IT-JPEG2000 also teaches: "wherein said information is in XML 
format" at page 157, section 1.9.1. 

As per claim 17, IT-JPEG2000 and Qian teach the digital file of claim 15 as 
discussed above. IT-JPEG2000 also teaches: "wherein said digital file is compliant with 
the JPEG2000 standard" at page 140, section 1. 4.6. 

As per claim 18, IT-JPEG2000 and Qian teach the digital file of claim 15 as 
discussed above. Qian also teaches: "wherein said information provides interactivity 
with said image" at Col. 4 lines 13-25. 

As per claim 19, IT-JPEG2000 and Qian teach the digital file of claim 18 as 
discussed above. Qian also teaches: "wherein said interactivity includes providing a 
bounding region of a portion of said image" at Col. 2 lines 45-50. 

As per claim 20, IT-JPEG2000 and Qian teach the digital file of claim 19 as 
discussed above. Qian also teaches: "wherein said bounding region is rectangular" at 
Col. 2 lines 60-65. 

As per claim 21, IT-JPEG2000 and Qian teach the digital file of claim 19 as 
discussed above. Qian also teaches: "wherein additional information regarding said 
content is associated with said bounding region of said image" at Col. 5 lines 22-30. 
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As per claim 22, IT-JPEG2000 and Qian teach the digital file of claim 15 as 
discussed above. Qian also teaches: "wherein said information includes links to 
information external to said JPEG2000 file" at Col. 2 lines 48-51 . 

As per claim 23, IT-JPEG2000 and Qian teach the digital file of claim 15 as 
discussed above. Qian also teaches: "wherein said information includes voice 
annotation" at Col. 5 line 24. 

As per claim 24, IT-JPEG2000 and Qian teach the digital file of claim 15 as 
discussed above. Qian also teaches: "wherein said information includes object 
boundary information" at Col. 5 line 24. 

As per claim 25, IT-JPEG2000 and Qian teach the digital file of claim 15 as 
discussed above. Qian also teaches: "wherein said information includes textual 
information regarding the content of said image free from copyright information" at Col. 
6 lines 15-17. 

As per claim 26, IT-JPEG2000 and Qian teach the digital file of claim 15 as 
discussed above. Qian also teaches: "wherein said information is MPEG-7 data" at Col. 
5 lines 25-30. 

As per claim 27, IT-JPEG2000 and Qian teach the digital file of claim 26 as 
discussed above. Qian also teaches: "wherein said MPEG-7 data is compliant with the 
MPEG-7 specification" at Col. 5 lines 25-29. 
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As per claim 28, IT-JPEG2000 and Qian teach the digital file of claim 26 as 
discussed above. Qian also teaches: "wherein said information includes binary data" at 
Col. 6 lines 1-20. 

As per claim 29, IT-JPEG2000 teaches a digital file stored on a computer 
readable medium, comprising: 

• "a plurality of boxes containing data arranged in a manner consistent with the 
JPEG2000 specification and suitable to render an image when read by a 
computer" at page 139, Fig. 1.1 and page 140, section 1. 4. 6; 

IT-JPEG2000 teaches the ability to add data to metadata boxes of a JPEG2000 
file (section I.4.5) but does not explicitly teach: "at least one of said boxes containing 
MPEG-7 compliant description schemes" as claimed. However, Qian teaches an 
analogous method for adding data to an JPEG2000 image to provide interactivity with 
said image, wherein the data comprises MPEG-7 compliant description schemes at Col. 
1 lines 59-67 and Col. 5 lines 22-30. Thus, it would have been obvious to one of 
ordinary skill in the art at the time of the invention was made to combine IT-JPEG2000 
and Qian's teachings. Qian suggests adding data information comprising MPEG-7 
compliant description schemes to a JPEG2000 file because "By associating MPEG-7 
descriptors to images, the images may be retrieved based on their graphical contents 
by advanced search engines. " at Col. 2, lines 30-35 and Col. 4 lines 13-25. 

As per claim 30, IT-JPEG2000 and Qian teach the digital file of claim 29 as 
discussed above. IT-JPEG2000 also teaches: "further including information within at 
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least one of a metadata box and a UUID box, wherein said information is in XML format" 
at page 139, Fig. 1-1 and page 157, section 1.9.1. Qian also teaches: "information 
describing the content of said image" at Col. 5 lines 22-30. 

As per claim 31, IT-JPEG2000 and Qian teach the digital file of claim 29 as 
discussed above. IT-JPEG2000 also teaches: "wherein said JPEG2000 file includes a 
metadata box" at page 140, section 1. 4.5. 

As per claim 32, IT-JPEG2000 and Qian teach the digital file of claim 30 as 
discussed above. Qian also teaches: "wherein said information provides interactivity 
with said image" at Col. 4 lines 13-25. 

As per claim 33, IT-JPEG2000 and Qian teach the digital file of claim 32 as 
discussed above. Qian also teaches: "wherein said interactivity includes providing a 
bounding region of a portion of said image" at Col. 2 lines 45-50. 

As per claim 34, IT-JPEG2000 and Qian teach the digital file of claim 33 as 
discussed above. Qian also teaches: "wherein said bounding region is rectangular" at 
Col. 2 lines 60-65. 

As per claim 35, IT-JPEG2000 and Qian teach the digital file of claim 33 as 
discussed above. Qian also teaches: "wherein additional information regarding said 
content is associated with said bounding region of said image" at Col. 5 lines 22-30. 
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As per claim 36, IT-JPEG2000 and Qian teach the digital file of claim 30 as 
discussed above. Qian also teaches: "wherein said information includes links to 
information external to said JPEG2000 file" at Col. 2 lines 48-51 . 

As per claim 37, IT-JPEG2000 and Qian teach the digital file of claim 30 as 
discussed above. Qian also teaches: "wherein said information includes voice 
annotation" at Col. 5 lines 24. 

As per claim 38, IT-JPEG2000 and Qian teach the digital file of claim 30 as 
discussed above. Qian also teaches: "wherein said information includes object 
boundary information" at Col. 5 line 24. 

As per claim 39, IT-JPEG2000 and Qian teach the digital file of claim 30 as 
discussed above. Qian also teaches: "wherein said information includes textual 
information regarding the content of said image free from copyright information" at Col. 
5 lines 23-24 and Col. 6 lines 15-17. 

As per claim 40, Col. 5 lines 23-24 and the digital file of claim 29 as discussed 
above. Qian also teaches: "wherein said MPEG-7 compliant description scheme 
includes binary data" at Col. 6 lines 18-21. 

As per claim 50, IP-JPEG2000 teaches the digital file of claim 47 as discussed 
above. IT-JPEG2000 teaches the ability to add data to metadata or UUID boxes of a 
JPEG2000 file (section 1. 4.5) but does not explicitly teach: "said information provides 
interactivity with said image" as claimed. However, Qian teaches an analogous method 
that enable association of descriptive data to an JPEG2000 image to provide 
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interactivity with said image at Col. 1 lines 59-67 and Col. 2 line 30-50. Thus, it would 
have been obvious to one of ordinary skill in the art at the time of the invention was 
made to combine IT-JPEG2000 and Qian's teachings. Qian suggests adding descriptive 
data information to a JPEG2000 file in order to "utiliz[e] such information in content- 
based information retrieval, object-based editing and manipulation application" at Col. 2, 
lines 30-35 and Col. 4 lines 13-25. 

As per claim 51 , IT-JPEG2000 and Qian teach the digital file of claim 50 as 
discussed above. Qian also teaches: "wherein said interactivity includes providing a 
bounding region of a portion of said image" at Col. 2 lines 45-50. 

As per claim 52, IT-JPEG2000 and Qian teach the digital file of claim 51 as 
discussed above. Qian also teaches: "wherein said bounding region is rectangular" at 
Col. 2 lines 60-65. 

As per claim 53, IT-JPEG2000 and Qian teach the digital file of claim 51 as 
discussed above. Qian also teaches: "wherein additional information regarding said 
content is associated with said bounding region of said image" at Col. 5 lines 22-30. 

As per claim 55, IT-JPEG2000 teaches the digital file of claim 47 as discussed 
above. IT-JPEG200 teaches that binary data can be added using UUID boxes at page 
158, section I.9.3, but does not explicitly teaches that "said binary data includes voice 
annotation" as claimed. However, Qian teaches an analogous method for adding data to 
an JPEG2000 image to provide interactivity with said image (Col. 2, lines 30-50), 
wherein the data includes voice annotation at Col. 1 lines 59-67. Thus, it would have 
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been obvious to one of ordinary skill in the art at the time of the invention was made to 
combine IT-JPEG2000 and Qian's teachings. Adding voice annotation to a JPEG2000 
file as suggested by Qian will enhance user experiencing with the JPEG2000 file by 
providing sound output in addition to displaying only still image. 

As per claim 56, IT-JPEG2000 teaches the digital file of claim 47 as discussed 
above. IT-JPEG200 teaches that binary data can be added to UUID boxes at page 158, 
section 1. 9.3, but does not explicitly teaches that "said binary data includes object 
boundary information" as claimed. However, Qian teaches an analogous method for 
adding data to an JPEG2000 image to provide interactivity with said, wherein the data 
includes object boundary information at Col. 2 lines 30-50. Thus, it would have been 
obvious to one of ordinary skill in the art at the time of the invention was made to 
combine IT-JPEG2000 and Qian's teachings. Qian suggests adding object boundary 
information to a JPEG2000 file in order to "utiliz[e] such information in content-based 
information retrieval, object-based editing and manipulation application" at Col. 2, lines 
30-35 and Col. 4 lines 13-25. 

As per claim 57, IT-JPEG2000 teaches the digital file of claim 47 as discussed 
above. IT-JPEG200 teaches that binary data can be added to UUID boxes at page 158, 
section 1. 9.3, but does not explicitly teaches that "said information includes textual 
information regarding the content of said image free from copyright information" as 
claimed. However, Qian teaches an analogous method for adding data to an JPEG2000 
image to provide interactivity with said, wherein "the data includes textual information 
regarding the content of said image free from copyright information" at Col. 5 lines 22- 
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30. Thus, it would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to combine IT-JPEG2000 and Qian's teachings. Qian suggests 
adding textual information to a JPEG2000 file in order to "utiliz[e] such information in 
content-based information retrieval, object-based editing and manipulation application" 
at Col. 2, lines 30-35 and Col. 4 lines 13-25. 

As per claim 58, IT-JPEG2000 teaches the digital file of claim 47 as discussed 
above. IT-JPEG2000 teaches the ability to add data to metadata boxes of a JPEG2000 
file (section 1. 4.5) but does not explicitly teach: "said information is MPEG-7 data" as 
claimed. However, Qian teaches an analogous method for adding data to an JPEG2000 
image to provide interactivity with said image, wherein the data comprises MPEG-7 data 
at Col. 5 lines 25-28. Thus, it would have been obvious to one of ordinary skill in the art 
at the time of the invention was made to combine IT-JPEG2000 and Qian's teachings. 
Qian suggests adding MPEG-7 data to a JPEG2000 file because "By associating 
MPEG-7 descriptors to images, the images may be retrieved based on their graphical 
contents by advanced search engines. " at Col. 2, lines 30-35 and Col. 4 lines 13-25. 

As per claim 59, IT-JPEG2000 and Qian teach the digital file of claim 58 as 
discussed above. Qian also teaches: "wherein said MPEG-7 data is compliant with the 
MPEG-7 specification" at Col. 5 lines 25-30. 

10. Claims 43-45 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Pereira as applied to claims 41-42 and 46 above, and in view of "MPEG-7 Multimedia 
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Description Scheme, Description Definition language V 3.0, N3391", (supplied by 
Applicant in IDS, paper No. 6), hereinafter referred to as "N3391". 

As per claim 43, Pereira teaches the digital file of claim 41 as discussed above. 
Pereira does not explicitly teach: "said description scheme includes a choice of two 
different encoding scheme for data, namely, base16 and base64" as claimed. However, 
N3391 describes a MPEG-7 description scheme, which includes "choice of two different 
encoding scheme for data, namely base16 and base64" at page 1 1 , section 6.2.4.7. 
Thus, it would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to employ the encoding scheme as taught in N3391 into Pereira's 
description scheme because N3391 represents the International Standard for MPEG-7 
description scheme. Using the encoding scheme as suggested by N3391 will ensure 
that the description scheme will be compliant with the standard, and therefore 
compatible with all applications implemented based on the standard. 

As per claim 44, Pereira and N3391 teach the digital file of claim 43 as 
discussed above. N3391 also teaches: "said base16 is part of an element name 
MediaData16" at page 11, section 6.2.4.7. 

As per claim 45, Pereira and N3391 teach the digital file of claim 43 as 
discussed above. N3391 also teaches: "said base64 is part of an element name 
MediaData64" at page 1 1 , section 6.2.4.7. 
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Response to Arguments 

1 1 . Applicant's arguments filed April 25, 2006 have been fully considered but they 
are not persuasive. The examiner respectfully traverses applicant's arguments. 

Regarding the 35 U.S.C 101 rejection to claims 1-59, applicant argued that 
digital files stored on a computer readable medium are statutory subject mater because 
"digital files are copied, sold, transferred from one location to another, and are capable 
of being project by intellectual property laws such as copyright law." The examiner 
respectfully submits that the claimed digital files comprise "mere arrangement of data", 
which is nonfunctional descriptive material, and therefore nonstatutory even if they are 
stored on computer readable media. Specifically, the claimed "digital files" of claim 1-59 
are in fact digital photos or videos stored on memory or a disks, similar to songs store 
on a CD, which is of course may be copyrightable but not patentable. For example, the 
person who takes pictures using a digital camera is always the rightful owner of the 
photos (i.e., the digital files stored in the flash memory), doesn't matter what method are 
used by the camera to encode the digital photos. 

Regarding claims 41-42 and 46, applicant argued that Pereira's MPEG-7 
description scheme does not include "data for rendering said at least one of said audio 
and visual media". On the contrary, Pereira teaches at page 6/2 that "the description 
information is associated with the content while that content is being capture", wherein 
the content includes audio and video data (bottom of page 6/1). Pereira also teaches 
"MPEG-7 descriptions may by physically co-jocated with the "reproduction data", in the 
same data stream", wherein the "reproduction data" corresponds to data for rendering 
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said audio and visual media as claimed. Applicant further argued that, in Pereira, the 
term "co-located" does not mean that the reproduction data is contained within the 
MPEG-7 description scheme. The examiner respectfully submits that Pereira teaches 
an embodiment where "MPEG-7 descriptions" and "reproduction data" are in the same 
data stream, Pereira also teaches on the same page that "description" and "stream" are 
the same. Therefore, when the reproduction data is included in a data stream, it is 
contained within the description scheme as claimed. 

12. Regarding claims 47-49 and 54, applicant argued that IT-JPEG 2000 does not 
teach the UUID box include information indicating the location of binary data because 
UUID box is different from UUID Info box. On the contrary, IT-JPEG2000 teaches that 
UUID boxes can be used to store binary data, and UUID Info boxes, which act as index 
for the UUID's in the file, contains a list of UUID's and specifies links (i.e., "location") to 
more information. UUID boxes and UUID Info boxes are distinct but within the 
JPEG2000 file . The examine therefore mapped IT-JPEG2000's UUID box and UUID 
Info boxes to the claimed "UUID box" and "metadata box", respectively. 

13. Regarding the 35 U.S.C 103 based upon Pereira and Qian, applicant 
attempted to disqualify the Qian reference by submitting the declaration with the 
statement that: "the subject matter disclosed in, and claimed by, the present application 
was reduced to practice on a date prior to May 30, 2000 the effective date of Qian et al., 
U.S. Patent No. 6,070,167 and provided evidence to support the fact that the disclosed 
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subject matter was reduce to practice before May 30, 2000. The Declaration is 
therefore treated by the examiner as a Declaration under 37 CFR 1 .131 . 

However, the Declaration is ineffective because the effective filing date of the 
Qian reference is September 29, 1997. MPEP provides: "the date to be overcome f 
under 37 CFR 1.131 is the effective U.S. filing date, not the foreign priority date. When 
a U.S. patent or U.S. patent application publication reference is entitled to claim the 
benefit of an earlier filed application, its effective filing date is determined under 35 
U.S.C. 102(e). See MPEP § 706.02(a), § 706.02(f)(1), and § 2136 through § 
2136.03". Since Qian is a proper prior art, the 35 USC 103 rejections based upon 
Pereira and Qian are proper and should be maintained. 

In view of the above argument, the 35 U.S.C 102 and 103 rejections are hereby 
sustained. 

Conclusion 

14. The prior art made of record, listed on form PTO-892, and not relied upon, if any, 
is considered pertinent to applicant's disclosure. 

If a reference indicated as being mailed on PTO-FORM 892 has not been 
enclosed in this action, please contact Lisa Craney whose telephone number is (571) 
272-3574 for faster service. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Khanh B. Pham whose telephone number is (571) 272- 
41 16. The examiner can normally be reached on Monday through Friday 7:30am to 
4:00pm. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Hosain Alam can be reached on (571) 272-3978. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

Khanh B. Pham 
Examiner 
Art Unit 2166 

August 18, 2006 




